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ABSTRACT 

An  investigation  directed  at  finding  the  best  low-order 
model  which  approximates  a  given  high-order  system  is  pre- 
sented.  New  insight  is  gained  into  the  cost  paid  for  the 
simplicity  of  the  model  and  in  the  accuracy  of  the  transient 
response  of  the  model  related  to  the  magnitude  of  a  cost 
function. 

The  problem  is  solved  in  the  time  domain  by  finding  the 
best  pole  and  zero  locations  of  the  model  which  minimize  a 
defined  error  criterion.   The  computer  is  used  to  estimate 
these  parameters,  via  a  parameter  minimizating  program.   A 
number  of  examples  are  included. 
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I.   INTRODUCTION 

The  process  of  modeling  a  given  system  by  a  system  of 
lower  dynamic  order  can  be  applied  in  order  to  simplify 
systems  prior  to  analysis  or  to  simplify  designs.   The 
initial  design  of  a  complex  system  is  more  easily  accom- 
plished if  we  can  determinate  a  low-order  model  which 
approximates  a  high-order  system  and  provides  useful  in- 
formation about  the  behavior  and  time-domain  response  of 
the  system. 

Most  works  on  control  and  simulation  theory  are  per- 
formed on  the  basis  that  a  mathematical  model  of  the  plant 
to  be  simulated  or  controlled  is  known,  although  this  model 
often  can  be  more  complicated  than  is  really  necessary. 
Simplification  of  the  model  seems  to  be  adequate  and  useful 
in  such  complex  dynamic  systems.   In  the  stated  problem  the 
two  major  cases  are: 
given   1.   The  measured  time-domain  transient  response  of 

a  system  to  a  known  input  driving  function, 
or      2.   The  input-output  relation  — exact  transfer 
function —  or  the  describing  set  of  differ- 
ential equations  of  a  linear,  constant  system 
of  order  "n" 
find  a  linear,  constant  system  of  order  "m"  which  best  ap- 
proximates the  given  system. 

A  number  of  mathematical  methods  and  numerical  tech- 
niques have  been  developed  and  proposed  as  an  approach  to 
the  solution  of  the  problem  in  specified  and  restricted 


cases.   All  of  them  present  radically  different  approaches 
but  they  can  be  divided  into  two  main  groups:  one  of  them 
is  to  retain  specified  eigenvalues  of  the  original  system 
and  to  neglect  those  which  do  not  contribute  much  to  system 
response;  the  other  is  based  on  the  estimation  of  a  set  of 
parameters  of  differential  equations  of  specified  order, 
the  response  of  which  approximates  that  of  the  original 
system  when  both  have  the  same  driving  function  as  inputs. 

The  approximation  problem  considered  by  Meier  [6]  uses 
a  quadratic  performance  index,  the  mean-square  difference 
between  the  output  of  the  given  system  and  the  output  of  the 
reduced  model  when  a  random  process  is  the  driving  function 
to  both  systems.   Necessary  conditions  for  optimum  parameter 
values  are  calculated  by  differentiating  the  performance 
index  with  respect  to  the  parameters.   The  approximated 
model  is  obtained  for  a  specified  or  chosen  suitable  value 
of  the  order  "m" . 

The  Meier  and  Luenberger's  approximation  [5]  deals  with 
the  modeling  by  a  system  of  fixed  lower  order  and  leads  to 
a  set  of  nonlinear  algebraic  equations  which  constitute  the 
set  of  necessary  conditions  for  the  optimal  approximating 
transfer  function  which  minimizes  an  integral  criterion. 

Both  methods  require  that  the  exact  transfer  function 
of  the  system  must  be  specified  and  assume  a  stationary 
random  process  as  input  to  exact  and  approximated  systems. 

Kuppurajulu  and  Elangovan  [4]  propose  a  method  for  re- 
ducing a  high-order  system  to  a  number  of  simplified  models 


by  dividing  the  total  time  of  response  into  a  number  of 
smaller  intervals.   The  reduction  is  based  on  retaining 
only  those  eigenvalues  of  the  system  which  have  dominant 
effect  during  the  time  interval  of  interest.   Thus  reduced 
models  can  be  obtained  for  the  initial,  intermediate  and 
final  stages  of  transient  response. 

Davidson  [8] ,  [9]  and  Chidambara  [9]  also  propose  a 
method  based  on  the  retention  of  specified  eigenvalues  of 
the  original  system  and  they  neglect  those  which  are  far 
from  the  jw-axis  since  they  make  little  contribution  to 
the  total  response,  except  at  the  beginning.   It  uses  rela- 
tionships from  the  time  solution  of  the  differential  equa- 
tions of  the  original  model  in  order  to  develop  the  reduced 
model.   It  is  a  projection  method:  a  projection  operator  is 
found  when  the  projection  error  is  minimized  and  then,  a 
contraction  process  is  operated  for  choosing  a  suitable 
basis  of  dimension  "m"  (m<n)  and  a  suitable  set  of  "m" 
variables . 

Anderson's  work  is  along  the  line  of  the  second  group, 
his  method  determines  a  reduced  model  by  minimization  of 
the  mean-square  error  between  the  responses  of  both  model 
and  original  system  over  a  given  interval.   It  uses  the 
orthogonal  projection  theorem  to  minimize  the  sum  of  the 
square  errors  at  the  sampling  instants,  and  the  steady- 
state  error  between  both  responses  is  not  forced  to  be  zero 

There  are  other  transfer  function  methods,  as  the  one 
of  Chen  and  Shich  which  is  based  on  the  continued  fraction 


expansion  in  polynomial  form  of  the  transfer  function, 
truncating  it  after  a  suitable  number  of  terms.   It  takes 
into  account  the  fact  that  the  quotients  in  the  expansion 
— by  the  final  value  theorem —  are  in  order  of  decreasing 
contributions  to  the  response  as  the  steady  state  is 
approached , 

But  in  general,  all  these  methods  require  an  exact  know- 
ledgment  of  the  system  transfer  function  and  this  requires 
that  in  practice  we  have  to  identify  exactly  the  system  in 
order  to  know  its  transfer  function  or  the  set  of  differ- 
ential equations  which  define  it.   Unfortunately  this  is 
seldom  achieved.   It  seems  more  realistic  to  use  directly 
the  measured  input-output  data  for  the  system  and  determine 
from  it  the  reduced  model  for  the  system. 

Sinha  and  Pillie  [1]  present  a  method  with  this  advan- 
tage based  on  the  use  of  the  matrix  pseudoinverse  to  esti- 
mate the  parameters  of  the  model  which  minimize  the  sum  of 
the  squares  of  the  errors  between  the  responses  of  the  sys- 
tem and  the  model  to  a  given  input.   It  only  requires  the 
measurements  of  the  input-output  data.   Sinha  and  Beraznai 
[3]  develop  a  more  general  method  for  any  specified  error 
criteria  of  optimization,  providing  flexibility  by  the  choice 
of  the  criterion  and  using  pattern  search  for  the  optimum 
approximation.   This  method  determines  the  optimum  low-order 
model  for  a  given  order  of  the  model  (a  model  of  order  "m" 
is  known,  m<n) . 


Fellows,  Sinha  and  Wismatch  [2]  propose  a  simple  method 
for  reducing  a  high-order  system  to  a  second-order  model. 
It  selects  the  second-order  model,  that  meets  specified  per- 
formance features  of  the  step-response  and  which  is  a  good 
approximation  to  the  step-response  of  the  actual  system, 
based  on  the  minimization  of  the  integral  of  the  square 
error  criterion. 

As  can  be  seen  during  recent  years  methods  and  techniques 
have  been  developed  and  applied  to  replace  a  complex  system 
by  a  simpler  system,  some  of  them  choosing  the  modes  to  be 
discarded  in  the  construction  of  the  new  low-order  system 
by  mathematical  techniques  and  the  other  ones  selecting  the 
order  "m"  (m<n)  of  the  model  and  calculating  the  optimum  m 
order  system  which  best  fits  the  original  by  different 
methods  and  criteria  for  the  minimization  process. 

In  this  thesis  it  is  intended  the  search  for  the  best 
model  which  fits  the  original  by  optimization  in  the  time 
domain,  or,  if  not,  to  answer  the  question  of  what  will  be 
the  price  which  it  is  necessary  to  pay  for  the  simplicity 
of  the  model  if  a  previously  selected  order  of  the  model  is 
specified  or  desired. 

Carrying  out  an  exhaustive  search  and  determination  of 
all  possible  low-order  models  for  specific  high-order  sys- 
tems, hopefully  seems  feasible  to  provide  a  basis  for  com- 
parison of  the  results  obtained  if  the  complete  set  of 
resulting  data  is  analyzed  and  studied  in  order  to  establish 
a  criterion  which  can  be  used  for  the  selection  of  the  model 
in  a  particular  problem. 
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Powerful  mathematical  tools  of  optimization  theory  and 
suitable  criterion  for  an  optimum  fit  in  the  solution  are 
used  in  the  practical  search  of  low-order  model  systems. 
Two  general  cases  are  investigated: 

1.  Modeling  based  on  using  directly  the  measured  input- 
output  data  for  the  system. 

2.  Modeling  when  the  exact  system  transfer  function  is 
specified. 

In  Chapter  II  of  the  thesis /  a  general  description  and  the 
philosophy  of  the  technique  for  the  solution  is  given,  and 
it  is  applied  in  Chapter  III  which  is  devoted  to  the  study 
of  four  general  examples  selected  as  a  guide  for  initializ- 
ing the  investigation  in  this  aspect  of  the  modeling  problem, 
This  search  can  be  thought  of  as  another  approach  to  the 
determination  of  low-order  models  and  as  an  effort  directed 
to  extend  the  research  done  in  this  sense. 
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II.   TECHNIQUE  FOR  SOLUTION 

A.   GENERAL 

In  dealing  with  the  modeling  of  high-order  systems  by 
an  optimum  low-order  model  two  main  cases  can  be  expected: 

1.  The  measured  input-output  data  for  the  system  is 
known . 

2.  The  exact  system  transfer  function  or  vector  dif- 
ferential equation  are  given. 

Some  assumptions  about  the  systems  have  to  be  made  for 
the  sake  of  convenience,  although  the  same  assumptions 
underline  most  of  classical  control.   It  is  assumed  that 
all  systems  are:  linear,  constant-coefficient,  asymptotically 
stable  and  single-input  and  single  output.   Under  these 
assumptions 

a.  the  linear  system  will  be  easier  to  study  than  the 
general  case . 

b.  a  second-order  system  is  clearly  simpler  than  a 
fourth-order  system. 

c.  all  poles  of  the  system  will  lie  in  the  left  half 
plane . 

Also  the  optimum  model  system  is  that  which  minimizes  the 
performance  index  previously  selected. 

The  dynamic  behavior  of  a  second-order  system  has  been 
thoroughly  studied  and  is  well  known,  thus  finding  a  pair 
of  complex  dominant  roots  — for  the  high-order  system  would 
be  equivalent  to  approximating  the  system  by  a  second-order 
model.   It  is  known  that  in  design  problems  of  high-order 
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feedback  systems  by  algebraic  methods,  the  designer  selects 
a  pair  of  complex  root  locations  and  then  tries  to  locate 
two  of  the  roots  of  the  system  at  these  locations  and  the 
other  ones  (undesired  roots)  at  remote  points  far  from  the 
jw-axis  in  the  left-hand  side  of  the  s-plane.   In  this  way 
the  transient  response  of  the  system  closely  follows  the 
selected  second-order  system's  response.   The  "dominant" 
character  is  achieved  if: 

a.  the  coefficients  in  the  time  response  associated 
with  the  desired  root  are  much  larger  than  those  associated 
with  undesired  roots. 

b.  the  time  constants  of  the  undesired  roots  are  much 
smaller  than  those  of  the  selected  pair. 

For  physical  systems,  closed-loop  poles  are  seldom  found 
at  the  origin  and  complex  poles  located  far  from  the  real 
axis  produce  oscillations  in  the  time-domain  response  of  a 
higher  frequency  than  those  located  closer  to  the  real  axis. 

In  this  work  it  is  assumed  that  the  step-response  of  the 
high-order  system  has  an  overshoot  at  least. 

B.   PHILOSOPHY  OF  APPROACH 

A  realistic  approach  to  the  derivation  of  the  low-order 
model  which  better  approximates  the  given  high-order  system 
is  to  perform  it  directly  from  the  known  response  of  the 
system  to  a  specified  driven  function  which  may  be  obtained 
experimentally.   If  the  system  is  to  be  operated  always  with 
a  specific  input  signal,  then  this  driving  function  can  also 
be  used  as  input  of  the  model  for  comparison  of  both 
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responses.   A  step  function  as  driving  function  is  very 
common  in  dynamic  system  test  and  identification  procedures, 
on  the  other  hand,  step-function  excitation  often  has  the 
important  advantage  of  simplicity. 

Thus,  the  problem  can  be  restated  as  the  determination 
of  the  transfer  function  of  the  low-order  model  which  is  an 
optimum  approximation  to  the  step-response  of  the  actual 
high-order  system,  based  on  some  criterion  of  goodness. 

It  was  felt  that  a  convenient  approach  leading  to  the 
problem  solution  is  the  determination  of  the  1''^^  optimum 
model  (Kn)  satisfying  some  specification  of  criterion 
rather  than  the  determination  of  a  specific  low-order  sys- 
tem, i.e.  a  second-order  model. 

1 .   Selecting  the  System  Response 

A  typical  time  characteristic,  acceleration  curve 
XQyi^(t)  of  an  actually  existing  dynamic  element  is  shown  in 
Fig.  II. 1.   In  a  general  case  an  acceleration  curve  consists 
of  a  delay  portion  of  duration  t^^,  a  concave  portion  Tj,  a 
constant-velocity  portion  T2 ,  a  convex  portion  T3  and  the 
steady-state  portion. 

Figure  II. 2  shows  typical  unit-numerator  step-response 
patterns  for  systems  up  to  sixth  order. 

If  the  step-response  of  a  system  takes  the  form 
shown  in  Fig.  II. 3,  it  can  often  be  approximated  as  a  time 
delay  plus  the  response  of  a  second-order  system  with  two 
complex  roots . 
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The  coiranon  characteristic  in  the  above  step-responses 
is  a  time  delay  t^^.   Very  often  in  the  study  of  practical 
high-order  systems,  this  concept  of  introducing  a  pure  time 
delay  to  account  for  the  higher  order  permits  interpretation 
and  study  of  the  step  response  in  terms  of  relative  stability 
and  the  nature  of  the  corresponding  frequency  response. 

Therefore,  the  high-order  system  response  to  a  step 
input-function  was  selected  as  a  pure  time  delay  plus  the 
response  of  a  second-order  system.   The  results  in  EXAMPLES 
I  and  II  were  obtained  working  with  this  assumed  typical 
high-order  system  response. 

2 .   Statement  of  the  Problem 

Let  the  given  n"'^^-order  linear,  time  invariant  sys- 
tem be  described  by 
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x(t)  =  A  x(t)  +  B  r(t)  ;    x(0)  =  0 

Y_{t)    =  C  x(t)  (II. 1) 

For  the  single-input  case  considered 

x(t)  =  A  x(t)  +  B  r(t)  ;    x(0)  =  0 

y(t)  =  C  x(t)  (II. 2) 

where  x(t)  is  the  n-dimensional  state  vector  and  the  "dot" 
over  a  variable  is  used  to  indicate  the  time  derivative 
(d/dt) .   A  is  a  "n  X  n"  matrix,  B  is  an  n-vector  and  r(t) 
is  the  scalar  time  function  representing  the  input  to  the 
system  (step- function) .   C  is  the  n-vector  and  y(t)  is  the 
output  of  the  system. 

Consider  a  discrete  set  of  values  of  y(t)  taken  over 
a  suitable  interval  of  time 

Y  =  -fyo'  Yi'    ^2' ^i' ^ts^  (II. 3) 

Yi  =  y(ti) 

which  represents  samples  of  the  response  of  the  system  de- 
scribed by  Eq.  (II.  2)  to  a  step-function  input.   It  may  have 
been  obtained  by  a  measuring  instrument  connected  to  the 
actual  system  output  with  a  sampling  interval  sufficiently 
small  in  order  that  no  information  be  lost. 

It  is  desired  to  find  the  best  low-order  model  de- 
scribed by 

X  =  Aj^  x^  +  B^  r(t)  ;    Xj.(0)  =  0  (II. 4) 

yr  =  C^  ^r 
whose  set  of  output  samples  Y^,  satisfies  the  condition  of 

minimizing  an  error  function  J (a)  given  by 
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J(a)  =  f(yi  -  Yri)  (II. 5) 

where  a  represents  the  N^^-vector  of  the  free  model  parameters. 
3 .   Error  Function  Criteria 

The  mean-square  criterion  was  chosen  as  the  function 
of  the  errors  (Yi'Yri^ •   This  performance  index  is  suitable 
for  many  minimization  problems  and  takes  the  form 

J(a)  =  E   Wi  (Yi  -  Yj-i)^  (II. 6) 

o 

where  n^  is  a  positive  integer  defined  as 

final  time  of  the  calculations    tf 

nf  = = (II. 7) 

sampling  period  T 

and  w-  is  a  weighting  sequence  which  for  the  single-output 

case  — assumed  in  this  work —  is  unity. 

When  (J)  is  minimized  with  respect  to  the  free  low- 
order  model  parameters  in  the  bounded  region  defined  by  the 
constraints,  the  optimum  values  of  the  free  parameters  are 
found.   Since  one  free  parameter  exactly  locates  one  root 
of  the  model,  when  the  error  criteria  is  minimized  the  set 
of  optimum  parameters  locate  all  the  roots  and  the  transfer 
function  of  the  optimum  model  is  determined. 

The  error  criterion  in  the  form 

/tf 
(Yi  -  yri)^dt  (II. 8) 

depends  on  tf,  but  once  tf   is  chosen  long  enough  and  fixed, 
it  does  not  affect  the  optimum  parameter  values  obtained  at 
the  end  of  the  minimization  process.  tf   was  chosen  as  the 
settling  time  of  the  time-domain  response  of  the  high-order 
system. 

18 


C.   METHOD  OF  SEARCH  FOR  BEST  MODEL 
1 .   Philosphy 

The  problem  of  approximating  the  high-order  system 
by  a  low-order  model  in  an  optimum  manner  was  solved  for  the 
specified  error  criterion  (see  Chapter  (II.B.3)). 

For  the  general  l^^h-model  (Eq.  II.  4)  the  closed  loop 

transfer  function  can  be  written  as 

Y^(s)   bj^s"^  +  bi^_is^"l  + . +  b^  s  +  bQ 

Gr(s)  = =— (II. 9) 

R(s)   s^  +  aj^_is^-l  + +  a^^  s  +  aQ 

or 


K(s+zi)  (S+Z2)  (s+Zm) 

G^(s)  = (11.10) 

(s+Pjl)  (S+P2)  (s+P^) 

which  is  a  function  of  the  transfer  gain  and  pole-zero  con- 
figuration, which  are  the  free  parameters  of  the  model. 

Assume  a  complex  system  presenting  a  step-response 
which  may  have  an  overshoot.   Then  Eq.  (11.10)  may  be 
modified 

K(s+zi)  (S+Z2) (s+Zj^) 

G^(s)  = ~ (11.11) 

(s2+2a-,  a2S+a5)  (s+p-^)  ....  (s+p^) 


where 


P1+P2  =  ^aj^a^ 

P1P2  =  ^i 
and  Pj^>0  (no  pole  at  origin) 

This  low-order  model  is  characterized  and  defined  by 

a  set  of  free  independent  parameters  which  can  be  chosen 

based  on  a  specified  error  function  criterion  in  order  to 

optimize  it.   For  given  values  of  the  pair  "1"  and  "m" 
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(in>l>n)  the  optimum  I'-^-order  model  which  minimizes  the 
error  criteria  is  realized  by  an  optimum  choice  of  the  free 
parameters.   It  is  reasonable  to  expect  the  value  of  the 
error  criteria  between  the  responses  of  the  actual  system 
and  the  model,  for  each  one  of  them,  will  decrease  as  the 
order  of  the  model  is  increased.   If  a  3-dimensional  param- 
eter space  is  considered  with  coordinates  axis 

XX'  :  number  of  zeros  of  the  model- 

YY •  :  number  of  poles  of  the  model 

ZZ'  :  values  of  the  error  criteria  for  optimum  model 
for  a  specific  value  of  the  transfer  gain,  the  set  of  error 
criteria  values  for  the  multiples  choices  of  both  number  of 
zeros  and  poles  will  be  represented  by  a  surface.   Hopefully 
a  minimum  to  this  surface,  if  it  exists,  would  represent  the 
minimum  of  all  minimum  error  values,  in  other  words,  it 
would  define  the  "best"  of  all  optimum  low-order  models  for 
a  specific  value  of  the  transfer  gain. 

The  decision  in  the  choice  of  the  lower  order  ap- 
proximated model  which  better  represents  the  given  system, 
if  there  is  not  a  net  minimum,  can  be  done  taking  into 
account  available  criterion  such  as:  limitations  on  the 
maximum  order  of  the  model  because  the  limitations  on  the 
available  model  components,  or  sufficiency  of  the  resultant 
error  criterion  (J)  which  satisfies  the  inequality 

J  -  J(j  >  0 
where  J^   is  a  minimum  boundary  — decision  criterion —  for 
the  error  criteria  (J).   In  this  way,  having  plotted  the 
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error  criteria  versus  a  specified  number  of  poles  and  zeros 
it  will  be  easy  to  decide  which  model  accomplishes  the  de- 
cision criterion  or  which  one  is  the  best  among  all  the  low- 
order  models  not  satisfying  it. 

Starting  with  a  model  with  poles  only  (no  zeros)  the 
optimum  set  of  parameters  can  be  determined  for  the  second- 
order  model  satisfying  the  selected  error  criteria,  the 
order  is  then  increased  by  one  and  a  third-order  model  is 
determined  in  the  same  way,  and  so  on.   Plotting  the  results 
will  show  the  variations  of  the  error  value  with  respect 
to  the  order  of  optimum  models .   Continuing  with  a  model  with 
one  zero,  the  same  search  is  performed  increasing  the  number 
of  poles  by  one.   Then  select  models  with  two,  three,., 
zeros  and  for  all  of  them,  again,  the  optimum  models  with 
increasing  number  of  poles  are  determined.   The  family  of 
curves  obtained  are  the  major  decision  tool  in  the  deter- 
mination of  the  optimum  low-order  models. 

2 .   Constraints 

In  order  to  get  the  optimum  low-order  system's  trans- 
fer function  it  is  necessary  to  find  the  optimum  value  of 
the  transfer  function  gain,  K,  and  the  best  locations  of 
zeros  and  poles  for  the  optimum  model.   Thus  the  number  of 
free  independent  parameters  at  least  is  equal  to  m+£+l, 
where 

m  :  number  of  zeros  of  the  model 

1  :  number  of  poles  of  the  model 

K  :  transfer  function  gain 
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As  was  stated  in  paragraph  II. B. 4,  a  3-dimension 
parameter  space  is  considered  for  representing  the  varia- 
tions of  the  error  criteria  as  a  function  of  both  number 
of  zeros  and  poles . 

In  setting  up  constraints  on  the  minimization  process 
the  transfer  function  gain  may  be  kept  constant  or  it  may  be 
allowed  to  vary  as  one  of  the  parameters.   If  it  is  variable 
then  a  4-dimensional  space  is  needed.   This  not  only  makes 
it  hard  to  find  the  minimum  of  the  surface,  but  the  concept 
of  a  varying  gain  is  not  consistent  with  most  physical 
problems  — at  least  not  for  control  systems.   Therefore  in 
this  study  the  gain  is  kept  constant. 

In  practical  systems  the  Body  gain,  i.e.,  the  trans- 
fer function  gain  when  written  in  Bode  form,  usually  is 
fixed  by  specifications.   In  many  applications  it  corre- 
sponds to  the  DC  gain  or  zero  frequency  gain.   If  the 
transfer  function  is  left  in  Root  Locus  form,  i.e.  (s+z)/ 
(s+p) ,  the  Root  Locus  gain  is  a  number  that  varies  with 
both  the  number  of  zeros  and  poles,  and  as  such  does  not 
usually  have  an  apparent  relationship  with  physical  system 
performance  characteristics. 

Therefore  the  Body  gain  is  kept  constant  in  the 
search  for  the  minimum,  and  it  is  also  constrained  to  be 
positive . 

In  order  to  ensure  the  stability  of  the  system  the 
pole  and  zero  location  is  restricted  to  the  Left  Hand  Plane 
only,  assuming  no  poles  at  origin. 
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3.  ■  Minimization  in  Parameter  Space 

The  error  criterion  or  performance  index  is  minimized 
with  respect  to  the  free  system  parameters  in  the  bounded 
parameter  space  defined  by  upper  and  lower  boundaries  on  the 
parameter  values  and  by  the  constraining  inequalities  and/or 
equations.   When  this  is  done  it  yields  the  best  zero  and 
pole  locations  for  the  given  lower  order  model. 

Various  search  techniques  may  be  considered  for  the 
minimization  process  of  the  specific  error  criteria.   Gradi- 
ent methods  are  quite  efficient  in  locating  a  minimum, 
although  the  necessity  of  calculating  partial  derivatives 
of  arbitrary  error  criteria  with  respect  to  all  the  free 
parameters  seems  to  be  a  disadvantage.   Direct  search  in- 
volves evaluating  the  effect  of  sequential  parameter  changes 
in  an  organized  manner. 

A  subroutine  for  the  minimization  of  an  arbitrary 
function  by  the  complex  method  of  M.  J.  Box  [14]  was  chosen 
as  a  suitable  method  for  this  work. 

An  important  problem  associated  with  every  search 
technique  is  the  selection  of  the  starting  parameter  values, 
because  of  their  considerable  influence  on  the  convergence 
of  the  process  and  on  the  probability  of  locating  the 
optimum  minimum.   If  the  step-response  of  the  high-order 
system  has  an  overshoot  it  is  felt  that  the  determination 
of  a  second-order  system  with  a  pair  of  conjugate  poles 
(dominant  roots)  will  be  a  good  approach  for  the  selection 
of  the  starting  parameter  values.   From  the  step-response 
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some  features  usually  can  be  specified:  the  maximum  over- 
shoot/ the  steady-state  response,  the  settling  time,  the 
time  to  reach  the  first  maximum;  therefore,  a  second-order 
system  that  meets  those  specification  approximately  can  be 
determined  using  the  analytical  expressions  or  the  universal 
curves  for  the  step-response  as  a  function  of  the  natural 
frequency  (w^)  and  the  damping  ratio  (C).   These  approximate 
parameter  values  are  used  as  starting  values  for  the  minimi- 
zation program  in  order  to  get  the  optimum  set  of  parameters 
for  the  second-order  model  and  successive  higher  order 
models . 

For  the  case  in  which  the  step-response  has  no  over- 
shoot a  simple  first  order  system  can  be  determined  by 

K 


G(s)  =• 


s+p 

p  =  1/t   ,  T  =  time  required  to  reach  0.632A. 

K  =  A.p   ,  A  =  steady-state  response  to  unit  step. 
for  the  selection  of  the  starting  parameter  values  in  the 
minimization  subroutine. 

This  thesis  considers  only  step-response  with  an 
overshoot  (more  general  case  for  physical  systems) . 

D.   PROGRAyiMING 

The  performance  index  (error  criteria)  is  minimized  with 
respect  to  the  free  system  parameters. 

A  subroutine  has  been  used  which  finds  the  minimum  in 
the  given  bounded  region. 
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At  each  of  the  minimization  procedure,  Eqs .  (II.  4)  and 
(11,8)  are  integrated  from  t=0  to  t=t£  by  using  a  fourth- 
order  Runge-Kutta  method.    The  optimum  parameter  and  mini- 
mum error  values  are  taken  back  to  the  main  program  which 
calls  another  subroutine  (SIMUL)  for  the  digital  simulation 
of  both  high-order  and  low-order  systems  in  order  to  get  a 
graph  representation  of  the  time-domain  responses  and  com- 
pare them. 

If  at  the  end  of  a  minimization  step  the  calculated 
parameters,  or  at  least  one  of  them,  are  on  the  limiting 
boundaries  then  the  limiting  boundary (s)  can  be  relaxed  and 
the  minimization  should  be  repeated  again  to  obtain  optimum 
parameter  values  for  the  new  boundaries. 

The  original  high-order  system  may  be  specified  either 
by  its  output  response  to  a  given  input  step-function  avail- 
able at  discrete  uniform  intervals  of  time,  or  by  the  closed- 
loop  transfer  function.   In  the  latter  case  the  main  program 
computes  the  transient  response  at  discrete  uniform  interval, 
stores  it  in  an  array  "look-up"  and  the  computation  con- 
tinues as  in  the  first  case. 

The  parameter  starting  values  for  the  model  to  be  used 
in  the  minimization  program  have  to  be  given  by  the  user. 

A  computational  flow  chart  is  shown  in  Fig.  II. 4. 


■^The  increment  time  for  the  integration  process  should 
be  equal  to  the  sampling  or  integration  times  for  the  given 
high-order  system. 

25 


INPUT: 
Input-output  measured 

data  of  the  system. 
N:  number  of  samples. 
DT :  sampling  interval 
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State  equations  of 
the  system. 
N:  number  of  points.    . 
DTj integration  interval . | 
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Explicit  constraints  on  the 
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FUNCTION  KE (X) : 
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by  the  user. 
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Otherwise  set  KE=-1 
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the  error  criterion  (J), 
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Figure  II.  4.   Computational  flow-chart. 
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Two  computer  programs  which  are  written  in  Fortran  IV, 
and  used  for  two  specific  models  of  the  Examples  I  and  IV 
are  given  at  the  end  of  the  thesis. 
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III.   INVESTIGATION  AND  DERIVATION  OF  MODELS  USING  MEASURED 
INPUT-OUTPUT  DATA  FOR  THE  SYSTEM 

A.   GENERAL 

It  was  felt  that  a  convenient  description  of  the  actual 
high-order  system  measured  input-output  data  has  the  form 
shown  in  Fig.  II. 3,  namely  a  pure  time  delay  plus  the  re- 
sponse of  a  second-order  system.   In  this  way  the  output  of 
the  system  is  obtained  and  sampled  at  suitable  time  interval 
(At)  . 

The  next  step  is  interpreting  the  features  of  the  step 
response  more  commonly  specified,  in  order  to  select  the 
starting  parameters  for  the  search  of  the  model  (as  was 
indicated  in  Chapter  II.  3).   Then  the  state  equations  of 
the  possible  model  are  integrated  with  respect  to  time  with 
a  step-input  function,  and  the  output  of  the  model  is  ob- 
tained and  sampled  at  At.   These  samples  are  compared  with 
the  values  of  the  response  of  the  system.   An  error  criteria, 
which  measures  the  deviation  of  the  sampled  model  values 
from  the  sampled  system  values  (from  zero  time  to  the  selected 
settling  time  of  the  system)  is  defined.   Minimization  of  this 
error  criterion  with  respect  to  the  model  parameters  yields 
the  optimum  model,  for  the  given  system  description,  using 
a  specific  order  for  the  model. 

The  starting  parameter  values  were  taken  as  is  stated 
in  Chapter  II,  Section  C.3. 
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B.   EXAMPLE  I 

The  input-output  measured  data  for  the  testing  system 
was  taken  as  the  step-response  of  a  second-order  system 
with 

C  =  0.316 

Wn=  (10.)^     "(poles  at:  -1.  +  j3)  (III.l) 

K  =  10. 
delayed  an  interval  t^  =  0.15  seconds. 

This  response  was  computed  by  digital  simulation  from 
0  to  5.2  seconds  and  520  samples  of  this  response  (at  inter- 
vals of  0.01  seconds)  were  used  for  the  determination  of 

4-Vi 

optimum  1   -order  models  by  minimization  of  the  error 
criterion  (Section  II. B). 

The  investigation  of  possible  models  was  carried  out 
starting  with  l'^"-order  models  (1  =  2,    3,....  7)  with  no 
zeros ,  and  then  repeating  the  search  for  models  with  one 
zerO/  then  with  two  zeros,  ending  with  models  with  three 
zeros.   It  is  considered  that  7  poles  and  3  zeros  are  a 
good  stop  criterion  for  analyzing  results. 

As  a  constraint  it  is  assumed  that  there  is  no  error 
in  steady-state  response  to  a  step  input,  keeping  the  Bode 
gain  constant. 

1.   Two  Poles  No  Zeros  Model 
a.   Model  response 

The  state  equations  of  the  second-order  model 
can  be  written  as 
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x^(t)= 


0        1 
■P1P2   ~^Pl+P2^ 


•x^(t)  + 


u(t) 


x^(0)=0 


(III. 2) 

where  u(t)  =  j[l(t)  /  ^ir^^^  ^^  ^^®  state  vector  of  the  model 
and  P1/P2  3^e  the  pole  locations  or  free  parameters  of  the 
model. 

The  output  of  the  model  is 
Y.r<t)  =  [k  0]  •  x^(t)  (III. 3) 

where  K  is  the  transfer  gain. 

Calling  a  the  N^-dimensional  vector  representing 
the  free  model  parameters  (where  N^=number  of  poles  +  number 
of  zeros) ,  the  state  equations  can  be  rewritten  as 


x^(t) 


0 

1 

^1 

0I 

• 

+ 

.-4 

-2a-,  a2 

^2 

ij 

!  •u(t) 


(III. 4) 


because  they  are  chosen  as  parameters  an  and  a2  —   the 
damping  ratio  and  natural  frequency. 

b.  Constraints 

The  only  constraining  equalities  and  inequalities 

are 

2 
K/a^  =  constant  =  1. 

0<a3^<0.5 

0<a2<5.5 

as  a  boundary  for  the  dynamic  response. 

c.  Result  of  the  minimization 
The  error  criterion  is  written  as 


(III. 5) 


J(a)  =  Xj(tf) 


Jo 


^   [y(t)  -  y^(t)]2  -dt 


(III. 6) 
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where  t^  =  final  time  of  the  sampled  complex  system. 

And  its  time  derivative  is 
Xj(t)  =  [y(t)  -  Yj-it)]^  (III. 7) 

The  integration  is  performed  with  increment  time 
At  =  sampling  interval  =  0.01  seconds. 

The  performance  index  x-r(a,t)  is  minimized  by 
the  computer  subroutine  with  respect  to  the  free  parameters; 
the  optimum  parameter  values  and  error  criterion  minimum 
value  are  tabulated  in  Table  III.l,  and  the  optimum  time 
response  of  both  the  original  and  optimum  second-order 
system  (for  a  unit  step  input)  are  plotted  in  Fig.  III. 5. 
2 .   Three  Poles  and  no  Zeros  Model 

a.   In  all  this  work  it  was  assumed  that  the  de- 
sired dynamic  response  of  the  model  was  represented  by  two 
complex  roots  and  a  certain  number  of  real  poles  and  zeros 
(because  of  the  overshoot  of  the  original  system) .   Thus 
for  this  case  the  model  transfer  function 

Yj.(s)                    K 
=  G^(s)  = (III. 8) 


U(s)  (s+pj^)  (S+P2)  (S+P3) 

can  be  written  as 

K 

G^(s)  = r ^ (III. 9) 

(s  +2a-j^a2S+a2)  (s+a3) 

where  the  free  system  parameters  vector  o^  is  represented  by 
and  each  a-  =  f  (p-i /P2 /P3)  .• 


a  = 


"3 
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The  state  equations  for  the  model  are  written  in  the 


form 


0 

1 

0 

0 

x^(t)    = 

0 

0 

1 

•x^(t)    + 

0 

-^1 

-^2 

-^3 

1 

u(t)    (III. 10) 


(III. 11) 


and  the  output  of  the  model  is 

Y.^it)    =  Pk  0  ol  •  x^(t)  ;   x^(0)=0 
where  each  aj^  =  f(a-L,a2/a3)  and  K  is  the  transfer  gain. 

b.   In  setting  constraints,  again  the  Bode  gain  was 
kept  constant  and  no  error  was  permitted  in  steady-state 
response  to  a  step  input 
K 


2 
2  3 


=   1. 


(III. 12) 


The  third  pole  (013)  was  constrained  to  an  upper 
bound  of  100  and  to  be  positive;  flexibility  was  given  in 
the  computer  program  for  changing  this  constraint  if  the 
upper  boundary  was  reached.   The  minimization  process 
showed  that  the  boundary  was  not  reached.   The  complex 
conjugate  poles  were  constrained  as  in  Section  III.B.l. 

Minimization  of  the  objective  function  (J)  yields 
as  optimum  parameter  values  the  result  tabulated  in  Table 
III.l  and  plotted  in  Fig.  III.l.   Figure  III. 6  shows  the 
time  responses   of  .both   the  system  and  the  desired  third- 
order  model  with  no  zeros. 

3.   More  Than  Three  Poles  and  No  Zeros  Models 

With  the  assumption  of  two  complex  conjugated  roots 
for  the  model  and  following  the  same  technique,  search  and 
determination  of  optimum  models  of  order  ranging  from  fourth 
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to  seventh  was  carried  out.   The  resulting  optimum  param- 
eters and  optimum  error  criteria  are  tabulated  in  Table 
III.l,  and  the  minimum  error  criterion  value  is  plotted 
versus  number  of  poles  in  Fig.  III.l. 
4 .   Models  With  Zeros 

The  number  of  zeros  of  the  model  was  increased  by 
one  and  determination  of  the  l^"-order  model  (2<^<7)  was 
investigated. 

The  state  equations  of  the  1   -order  system  are 
written  in  the  form 


Xj.(t)  =  A^x^(t)  +  B^u(t) 


x^(0)  =  0 


(III. 13) 


where 


^  = 


-ai   -a. 


0 
0 

• 

1 

-a, 


B. 


;   u(t)  =  jl(t; 


(III. 14) 


and  the  output  of  the  model  is 

^^{t)    =  C^x^(t)  (III. 15) 

where 

Cj,  =  K  [b^  h^    h^]  (III. 16) 

In  the  same  way  as  in  section  (2.  a)  the  coefficients  a^^  and 
bj_  are  functions  of  the  free  parameters  (poles  and  zeros)  of 
the  model  system.   They  are  expressed  as  the  sum  of  com- 
binations of  products  of  the  free  parameters. 


33 


Each  model  was  minimized  with  respect  to  the  selected 
error  criterion  (Eq.  (III.6)).   The  final  time  for  the  inte- 
gration is  taken  as  the  final  time  sampled  (t£=5.2  seconds). 

Again  the  starting  parameter  values  were  taken  from 
the  second  order  model  and  the  boundaries  from  the  same  model 
with  no  zeros.   Flexibility  was  given  for  changing  the  upper 
and  lower  bounds  if  any  of  them  was  reached  and  the  result 
was  a  constrained  minimum.   Constant  Bode  gain  and  zero  error 
between  both  steady-state  responses  were  required. 

The  resulting  free  parameter  values  for  each  optimum 
model  are  tabulated  in  Tables  III.  2,  III. 3  and  III. 4  (and 
the  corresponding  error  criterion  values) .   A  plot  of  the 
cost  function  (J)  versus  the  number  of  poles,  for  constant 
number  of  zeros,  is  showed  in  Figs.  III.  2,  III. 3  and  III.  4. 

Table  III.  5  is  a  comparison  of  the  error  criterion 
values  for  all  models  studied  in  this  example  and  it  shows 
the  existance  of  a  best-optimum  low-order  model.   Figs.  III. 7 
to  III. 18  show  the  time  response  of  the  system  and  several 
models. 

5 .   Remarks 

Looking  at  the  tabulated  results  in  Table  III. 5, 
which  is  a  resume  of  the  study  done  with  this  system  and  a 
clear  basis  of  comparison  between  all  the  models,  and  at 
the  plotted  values  of  the  performance  index  (J)  versus 
number  of  poles,  some  facts  can  be  clearly  pointed  out: 
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#  Of 
Poles 

2 

3 

4 

5 

6 

7 

K 

.35 

.288 

.297 

.303 

.309 

.31 

Wn 

2.734 

3.145 

3.148 

3.148 

3.138 

3.137 

P3 

6.24 

7.8 

9.35 

13.46 

14.25 

P4 

37.1 

29,7 

25.4 

24.98 

Ps 

87.24. 

41.57 

69. 

P6 

111.9 

87.7 

P7 

98.74 

JxlO"^ 

131. 

5.17 

4.7 

5.09 

6.09 

6.4 

TABLE  III.l.   EXAMPLE  I.   Optimum  models  without  zeros 


#  Of 
Poles 

2 

3 

4 

5 

6 

7 

C 

.351 

.25 

.296 

.301 

.302 

.303 

wn 

2.72 

2.99 

3.15 

3.147 

3.141 

3.144 

P3 

2.69 

8.46 

8.2 

8.64 

8.2 

P4 

12.84 

9.22 

10.34 

15.57 

P5 

22.36 

37.4 

38.72 

P6 

87.1 

61.66 

P7 

91.75 

21 

199.8 

5. 

25.1 

8.14 

10.1 

11.4 

JxlO^ 

140. 

36. 

4.4 

4.8 

5. 

5.4 

TABLE  III. 2.   EXAMPLE  I.   Optimum  models  with  one  zero 
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#    of 
Poles 

3 

4 

5 

6 

7 

K 

.274 

.29 

.294 

.298 

.296 

^N 

3.126 

3.147 

3.149 

3.145 

3.149 

P? 

4.96 

8.46 

7.595 

9.67 

7,4 

P4 

9.52 

14.327 

10.086 

15.44 

PR 

20.428 

48.778 

35.34 

P6 

53.34 

65.55 

P7 

105.6 

zi 

34.76 

28.13 

18.11 

14.68 

14.55 

Z2 

148.9 

33.57 

26.7 

49.55 

36.13 

JxlO^ 

8.4 

4.5 

4.5 

4.61 

4.8 

TABLE  III.3..  EXAMPLE  I.   Optimum  models  with  two  zeros 


#    of 
Poles 

4 

5 

6 

7 

C 

.295 

.281 

.295 

.297 

^N 

3.152 

3.139 

3.151 

3.003 

P3 

9.7 

6.67 

9.372 

0.014 

P4 

10.  87 

8.6 

10.104 

20.78 

P5 

153.9 

43.54 

25.76 

Pf^ 

120.91 

47.52 

P7 

82.91 

^1 

49.8 

20.19 

19. 

0.013 

^? 

98.78 

23.7 

62.45 

17.032 

z-^ 

116.58 

53.76 

82.86 

26.348 

JxlO"^ 

4.24 

4.402 

4.406 

4.47 

TABLE  III. 4.   EXAMPLE  I.   Optimum  models  with  three 

zeros . 
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JxlO 
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Model  with 
two  zeros 
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Figure  III. 3. 
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*  6. 

-  4. 
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Model  with 
three  zeros 
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Number  of  Poles 


Figure  III. 4. 


38 


Figure  III. 5.   EXAMPLE  I 


System's  response  (A)  and  the  Two 
Poles  no  Zero  ir.odel's  response 
(B)  to  a  unit  step  input. 
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Figure  III.  6.   EXAMPLE  I 


System's  response  (A)  and  the 
Three  Poles  no  Zero  model's  re- 
sponse (B)  to  a  unit  step  input. 
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Figure  III. 7.   EXAMPLE  I 


System's  response  (A)  and  the  Four 
Poles  no  Zero  model's  response  (B) 
to  a  unit  step  input. 
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Figure  III. 8 


2. 

EXAMPLE  I 


3.         4.         5.         6, 

System's  response  (A)  and  the  Five 
Poles  no  Zero  model's  response  (B) 
to  a  unit  step  input. 
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Figure  III.  9.   EXAMPLE  I 


3. 


4. 


5. 


6. 


System's  response  (A)  and  the  Six 
Poles  no  Zero  model's  response  (B) 
to  a  "unit  step  input. 
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Figure  III. 10.   EXAMPLE  . I 


3.         4.         5. 

System's  response  (A)  and  the 
Three  Poles  and  One  Zero  model ' s 
response  (B)  to  a  unit  step  input 
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0.        1.         2. 

Figure  III. 11.   EXAMPLE  I 


System's  response  (A)  and  the 
Four  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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0.        1.         2. 

Figure  III. 12.   EXAMPLE  I 


3.         4.         5. 

System's  response  (A)  and  the 
Five  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input . 
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0.        1.         2. 
Figure  III. 13.   EXAMPLE  I 


3.         4.         5. 

System's  response  (A)  and  the 
Six  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input . 
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Figure  III. 14 


2. 

EXAMPLE  I. 


6. 


3.         4.         5. 

System's  response  (A)  and  the 
Three  Poles  and  Two  Zeros  model's 
response  (B)  to  a  unit  step 
input. 
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0.        1.         2. 

Figure  III. 15.   EXAMPLE  I 


3.         4.         5. 

System's  response  (A)  and  the 
Four  Poles  and  Tv;o  Zeros  model's 
response  (B)  to  a  unit  step 
input. 
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TIMS 
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Figure  III. 16 


2. 

EXAMPLE  I 


3. 


4. 


5. 


System's  response  (A)  and  the 
Six  Poles  and  Two  Zeros  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III. 17.   EXAMPLE  I 


3. 


4. 


5. 


System's  response  (A)  and  the 
Five  Poles  and  Three  Zeros 
model's  response  (B)  to  a  unit 
step  input. 
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0.        1 

Figure  III.l 


2. 

EXAMPLE  I. 


System's  response  (A)  and  the 
Seven  Poles  and  Three  Zeros 
model's  response  (B)  to  a  unit 
step  input. 
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a.  A  best  optimum  model  seems  feasible. 

b.  The  models  in  the  range  from  four  poles  to  seven 
poles  achieve  a  very  acceptable  error  criterion  value. 

c.  The  second-order  model  does  not  seem  a  very  good 
approximation . 

d.  The  simplicity  of  a  specific  order  model  can  be 
weighted  versus  criterion  error  value. 

e.  As  the  order  of  the  model  is  increased  the  poles 
go  far  away  on  the  real  axis.   On  the  other  hand  the  error 
criterion  value  remains  almost  unchangeable  increasing  the 
order.   Thus  it  can  be  thought  that  adding  poles  to  the 
model  is  not  going  to  minimize  the  performance  index. 


"'XsPoles 
Zeros^v,^^^^ 

1 

2 

3 

4 

5 

6 

7 

0 

131. 

5.17 

4.7 

5.09 

6.09 

6.4 

1 

140. 

36. 

4.4 

4.8 

5.0 

5.4 

2 

8.4 

4.5 

4.5 

4.61 

4.8 

3 

4.24 

4.402 

4.406 

4.47 

TABLE  III. 5.   Error  criterion  (JxlO^)  for  models  in 
Example  I . 


C.   EXAMPLE  II 

The  input-output  measured  data  of  the  high-order  system 
was  taken  as  the  step-response  of  a  second-order  system  with 
the  same  features  (Eq.  (III.l))  as  in  Example  I,  delayed  an 
interval  approximately  twice  the  above  t^.   Thus,  now 
^d  ~  ^^d  ~  ^  • -^  seconds. 
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536  samples  of  the  input-output  assumed  response  (at  in- 
tervals of  0.01  sec.)  were  used  as  measured  data  for  the 
derivation  of  the  I'^^^-order  optimum  models  by  minimization 
of  the  performance  index  defined  in  Eq.  (III. 6). 

The  investigation  was  performed  using  the  technique  of 
Example  I .   All  possible  models  were  determined  of  order 
ranging  from  no  zeros  and  two  poles  to  seven  poles  and  three 
zeros.   The  optimum  pole  and  zero  locations  obtained  for 
each  model  are  tabulated  in  Tables  III. 6  to  III. 9  and  plots 
of  the  error  criteria  values  versus  number  of  poles  are 
shown  in  Figs.  III. 19  and  III. 20  for  specific  numbers  of 
zeros . 

For  further  comparison  between  all  models  Table  III. 10 
shows  the  performance  index  (error  criteria)  values  for 
each.   Figs.  III. 21  to  III. 36  show  the  time  responses  of 
various  models  and  the  original  system. 

1.   Remarks 

The  following  comments  should  be  noted: 

a.  If  l>k  the  results  show  that  the  optimal  model 
of  order  "1"  is  better  than  the  optimal  model  of  order  ""k". 
The  error  criterion  value  decrease  as  the  order  of  the 
model  increases,  although  in  any  cases  the  error  values 
for  the  fourth-order  model  (no  zeros)  and  higher  can  be 
considered  acceptable. 

b.  For  a  specific  number  of  poles,  adding  a  zero 
to  the  model  maintains  the  cost  function  value  at  about  the 
same  magnitude. 
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#  of 
Poles 

2 

3 

4 

5 

6 

7 

^ 

.405 

.228 

.255 

.266 

.275 

.282 

Wn 

2.34 

2.995 

3.136 

3.145 

3.156 

3.16 

P3 

2.93 

5.94 

6.59 

7.51 

10.17 

P4 

5.896 

6.73 

11.03 

9.67 

P5 

30.9 

10. 

10.52 

P6 

174.91 

68.89 

P7 

70.33 

JxlO"^ 

490. 

63.6 

18.5 

12.6 

8.2 

6.3 

TABLE  III.  6.   EXAMPLE  II.   Optimum  models  with  no  zeros 


#  of 
Poles 

2 

3 

4 

5 

6 

7 

C 

.407 

.227 

.252 

.252 

.274 

.285 

Wn 

2.328 

2.988 

3.13 

3.123 

3.156 

3.158 

P3 

2.885 

5.62 

5.69 

8.38 

10.7 

P4 

5.81 

5.73 

8.86 

10.97 

P5 

30.01 

10.02 

11.06 

P6 

132.86 

20.01 

P7 

159.55 

zi 

199.8 

219.35 

97.88 

21.98 

89.37 

117.12 

JxlO^ 

500. 

66.8 

21.1 

13.2 

8.7 

5.8 

TABLE  I I I. 7.   EXAMPLE  II.   Optimum  models  with  one  zero 
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#  of 
Poles 

-^ 

4 

5 

6 

7 

C 

.222 

.246 

.257 

.274 

.277 

WN 

2.965 

3.105 

3.13 

3.154 

3.154 

P3 

2.75 

5.13 

5.14 

6.96 

7.03 

P4 

5.69 

10.37 

9.998 

11.17 

P5 

12.64 

13.77 

13.48 

P6 

29.8 

28.8 

P7 

101.97 

21 

64.98 

57.85 

40.2 

88.64 

61.9 

Z2 

199.38 

75.6 

149.5 

102.87 

163.5 

JxlO^ 

78. 

26.9 

15.4 

8.4 

7.9 

TABLE  III.  8.   EXAMPLE  II.   Optimum  models  v;ith  two  zeros 


#  of 
Poles 

4 

5 

6 

7 

C 

.244 

.258 

.271 

wn 

3.103 

3.13 

3.15 

P3 

5.064 

5.53 

9.001 

P4 

5.514 

7.73 

9. 

P5 

12.78 

9.011 

P6 

20. 

^1 

49.12 

38.52 

27.65 

^2 

110.57 

50.54 

76.84 

^3 

119.32 

191.07 

175.3 

JxlO"^ 

29.1 

17.3 

9.3 

7.9 

TABLE  III. 9.   EXAMPLE  II.   Optimum  models  with  three  zeros 
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c.  Between  one  model  and  the  next  one  (increasing 
the  order  by  adding  a  pole)  the  additional  pole  does  not 
affect  the  initial  pole  location  appreciably.   They  remain 
approximately  the  same,  and  the  new  pole  is  set  far  away  to 
the  left  (in  the  s-plane) . 

d.  The  second-order  model  is  the  worst. 

e.  Selection  of  the  desired  model  can  be  done 
easily  depending  on  the  desired  simplicity,  looking  at  the 
transients  responses  of  both  (original  and  approximated) 
systems  and  with  a  little  margin  for  the  cost  function 
value  it  can  be  seen,  in  this  example,  that  the  fourth-order 
model  fits  very  well. 

f.  The  complex  root  values  for  the  various  models 
remain  in  a  very  small  area,  i.e.,  their  values  are 
essentially  unchanged  by  the  addition  of  poles  and  zeros. 


"^'^v^oles 
ZerosV,^^^^^ 

1 

2 

3 

4 

5 

6 

7 

0 

490. 

63.6 

18.5 

12.6 

8.2 

6.3 

1 

500. 

66.8 

21.1 

13.2 

8.7 

5.8 

2 

78. 

26.9 

15.4 

8.4 

7.9 

3 

29.1 

17. 

9.3 

7.9 

TABLE  III.  10 


Error  criterion  (JxlO"^)  for  models  in 
Example  II. 


D.   EXAMPLE  III 
1.  '  General 

A  transfer  function  G(s)  of  a  seventh-order  system 
with  no  finite  zeros  is  given  by 
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Figure  III. 21.   EXAMPLE  II 


System's  response  (A)  and  the 
Two  Poles  no  Zero  model's  re- 
sponse (B)  to  a  unit  step  input. 
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Figure  III. 22.   EXAMPLE  II 


System's  response  (A)  and  the 
Three  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III. 23 


2. 

EXAMPLE  II 


3. 


4. 


5. 


System's  response  (A)  and  the 
Four  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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2. 

EXAMPLE  II. 


3. 


4. 


5. 


6. 


System's  response  (A)  and  the 
Five  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure    III.  25.      EXAJ-IPLE    II. 


System's  response  (A)  and  the 
Seven  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III.  26.   EXAMPLE  II. 


System's  response  (A)  and  the 
Three  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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-2. 

EXAMPLE  II. 


System's  response  (A)  and  the 
Four  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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0.        1. 

Figure  III.  28 


EXAMPLE  II 


System's  response  (A)  and  the 
Five  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input . 
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6. 


Figure  III. 29 


System's  response  (A)  and  the 
Six  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III.  30 


2. 

EXAMPLE  II. 


3. 


4. 


5. 


System's  response  (A)  and  the 
Seven  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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2. 

EXAMPLE  II. 


System's  response  (A)  and  the 
Four  Poles  and  Tx^jo    Zeros  model's 
response  (B)  to  a  unit  step 
input . 
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0.        1. 

Figure  III. 32 


2. 

EXAMPLE  II. 


System's  response  (A)  and  the 
Six  Poles  and  Two  Zeros  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III. 33 


System's  response  (A)  and  the 
Seven  Poles  and  T\'70  Zeros 
model's  response  (B)  to  a  unit 
step  input. 
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0.        1. 
Figure  III. 34 


2. 

EXAMPLE  II 


System's  response  (A)  and  the 
Four  Poles  and  Three  Zeros 
model's  response  (B)  to  a  unit 
step  input. 
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0.        1. 
Figure  III. 35 


2. 

EXAMPLE  II. 


System's  response  (A)  and  the 
Five  Poles  and  Three  Zeros 
model's  response  (B)  to  a  unit 
step  input. 
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2. 


EXAMPLE  II 


3. 


4. 


5. 


System's  response  (A)  and  the 
Six  Poles  and  Three  Zeros 
model's  response  (B)  to  a 
unit  step  input . 
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384    X    lo'^ 
G(s)= 

s'^+432s^+62670s^+3615900s^+75114000s^+553920000s^.  .  . 

.  .  +  1443200000s+384xl0'7       (III. 17) 

or   in   factorized   form 

384    X    lo"^ 

G(s)= (III. 18) 

(s2  +  2s+10)  (s+10)  (s+20)  (s+80)  (s+120)  (s+200) 

The  response  of  this  system  to  a  unit  step  was  com- 
puted from  0  to  8.4  seconds  and  700  samples  of  this  response 
(at  intervals  of  0.012  seconds)  were  used  for  the  determina- 

i_T_ 

tion  of  optimum  1   -order  models  by  minimizing  the  objective 
function  specified  in  Chapter  II. B. 3. 

It  was  decided  to  obtain  all  the  low-order  models  of 
the  seventh-order  system  described  by  Eq.  (III. 17)  following 
the  same  technique  as  Examples  I  and  II.   First  obtaining  a 
second-order  model  with  no  zeros.   Having  found  the  optimum 
parameters  using  the  computer  programme,  the  order  is  then 
increased  by  one  and  a  new  model  is  selected  and  determined. 
When  the  sixth-order  model  is  determined  the  number  of  zeros 
is  also  increased  by  one  and  new  models  are  found.   In  this 
way  the  search  is  completed  when  the  six  poles  and  three 
zeros  model  is  determined. 

The  main  features  of  the  step  response  are  given 
below: 

Time  to  reach  first  overshoot  1.18  seconds 

Maximum  overshoot  30% 

Steady-state  value  1 

Initial  slope  0 
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Response  at  maximum  overshoot  1.33 

Rise  time  0.7  seconds 

2 .   The  Model  Response 

The  desired  model  response  was  represented  by  two 
dominant  complex  conjugated  roots  and  a  number  of  real  poles 
depending  on  the  model's  order. 

From  the  curves  of  the  step-response  of  a  second 
order  system  v;ith  no  finite  zeros  and  the  above  features, 
starting  parameters  for  the  second  order-model  were  selected 
as : 

a]_  =  C  =  0.3 

«2  =  "n  =  3-5 
and  t£  =  8.4  seconds.   In  the  same  way  using  the  universal 

curves  of  the  second-order  linear  system  step  response 

characteristic,  reasonable  bounds  were  chosen  as: 

0.1<a-j<0.55 

(III. 19) 
1 .  5<a2<t'6  . 

in  order  to  set  constraints  on  the  free  parameters  (a]^,a2) 

for  the  determination  of  the  second-order  model,  which  will 

be  starting  parameter  values  (Chapter  II. C)  of  the  increasing 

order  models. 

The  state  equations  of  the  system  are  written 
directly  from  Eq.  (III. 17). 

The  error  criterion  defined  by  Eq.  (III. 18)  is 
minimized  by  the  computer  subroutine. 
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3.  The  Second-Order  Model 

The  state  equations  can  be  written  as  Eq.  (III. 4). 

The  Bode  gain  was  kept  constant  with  no  steady- 
state  error  between  both  responses  (system  and  model) . 

Constraints  were  set  on  the  free  parameters  as 
indicated  in  inequalities  (III. 19). 

The  optimum  parameter  values  and  minimum  error 
criterion  are  tabulated  in  Table  III. 11,  and  the  Fig. 
III. 37  shows  a  plot  of  the  error  criterion  (J)  value. 

4 .  Models 

As  was  done  in  Examples  I  and  II,  all  the  different 
order  models  ranging  from  the  two  poles  and  no  zero  to  the 
six  poles  and  three  zero  were  determined. 

Also  as  a  basis  of  comparison,  the  seven  poles  no 
zeros  model  was  determined;  the  optimum  parameter  values 
for  this  model  are  very  close  to  the  real  parameter  values 
of  the  seventh-order  test  system,  and  the  value  of  the 
performance  index  (J)  is  the  smallest  of  all  (really  it 
would  be  zero  but  for  the  limitations  on  computer  accuracy) . 

In  Tables  III. 11  to  III. 14  are  shown  the  different 
sets  of  free  parameter  values  for  each  of  the  optimum 
specific-order  models  and  the  corresponding  error  criterion 
values , 

Plots  showing  the  variation  of  J  versus  the  number 
of  poles  of  the  model  are  given  in  Figs.  III. 37  and  III. 38. 

In  order  to  get  a  basis  of  comparison  between  models 
and  resultant  values  of  the  cost  function  (J)  for  all  of 
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.309' 

.319 

.321 

.319 

3.162 

^N 

2.684 

3.135 

3.156 

3.158 

3.155 

3.159 

10 

P3 

5.32 

7.91 

13.83 

14.75 

11.12 

20 

P4 

18.66 

14.72 

17. 

19.34 

80 

P5 

36,73 

33.34 

78.81 

120 

P6 

107.75 

119.1 

200 

P7 

181.2 

System 

Jx 

in  4 

161. 

4.1 

0.45 

.31 

.404 

.3 

TABLE  III. 11.   EXAMPLE  III.   Optimum  models  with  no  zeros 
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6 
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.316 
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.371 

.296 

.31 

.312 

.317 

.319 

3.162 

^N 

2.673 

3.09 

3.163 

3.164 

3.162 

3.159 

10 

P3 

6.18 

10.4 

9.37 

12.6 

12.43 

20 

P4 

11.18 

14.22 

12.94 

16.37 

80 

P5 

77.7 

63.13 

66.8 

120 

P6 

128.4 

90. 

200 

P7 

160.7 



^1 

249.9 

219.3 

79.1 

57.73 

92.19 

164.8 

Test  4 
System  • 

Jx 

168. 

4,5 

0.52 

0.41 

n.27  , 

0.31 

TABLE  III. 12.   EXAMPLE  III.   Optimum  models  with  one  zero. 
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7 

3 

4 

5 

6 

.316 

r, 

.285 

.304 

.309 

.314 

3.162 

v^N 

3.16 

3.161 

3.165 

3.163 

10 

P3 

4.95 

8.54 

8.84 

9.42 

20 

P4 

10.34 

12.75 

22.2 

80 

P5 

71.86 

31.16 

120 

P6 

37.9 

200 

^1 

99.7 

46.55 

47.75 

36.5 



^2 

238.3 

65.33 

103.1 

89.76 

Test  A 
System  | 

Jx 
10^ 

5.5 

1.3 

.65 

.29 

TABLE  III. 13.   EXAMPLE  III.   Optimum  models  with  two 

zeros . 
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Test  A 
System! 

Jx 
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1. 

TABLE  III.  14 


EXAMPLE  III. 


Optimum  model  with 
three  zeros. 
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Figure  III. 38. 


Z   X 

2 

3 

4 

5 

6 

0 

161. 

4.1 

0.45 

0.31 

0.404 

1 

168. 

4.5 

0.52 

0.41 

0.27 

2 

5.5 

1.3 

0.65 

0.29 

3 

1.005 

— 

— 

TABLE  III.  15.   Error  criterion  (JxlO"^)  for  models 

in  Example  III . 
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them  are  tabulated  in  Table  III. 15.   Figures  III.  39  to 
III.  49  show  the  transient  responses  of  both  the  system  and 
the  reduced  model  for  different  pole  and  zero  values. 
5 .   Remarks 

Some  facts  can  be  pointed  out  looking  at  Tables 
III. 11  to  III. 15  and  at  Figs.  III. 37  and  III. 38,  such  as: 

a.  The  second-order  models  (no  zero  and  one  zero) 
do  not  appear  to  be  suitable. 

b.  A  model  which  gives  a  minimum  value  of  the 
error  criteria  is  the  six  poles  one  zero  model,  although 
any  model  in  the  range  from  four  to  six  poles  (and  even 
the  third-order  model)  give  small  values  of  the  error 
criteria. 

c.  As  the  order  of  the  model  is  increased  the 
locations  of  optimum  poles  values  approaches  the  real 
values.   Since  the  error  criterion  remains  almost  the  same 
in  the  range  from  four  to  six  poles ,  the  poles  located  far 
away  contribute  very  little  to  the  general  transient  re- 
sponse (performance  of  the  system) . 

d.  If  it  is  desired  to  represent  the  system  by  a 
specific  order  model,  the  tables  indicate  the  cost  paid 
for  the  simplicity.   Similar  tables  can  be  constructed  for 
any  specific  problem. 

E.   EXAMPLE  IV 
1.   General 

It  was  decided  to  select  the  model  of  a  real  physical 
system  in  order  to  continue  the  investigation  of  the  reduced 
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Figure  III.  39.   EXAMPLE  III 


System's  response  (A)  and  the 
Two  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input . 
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Figure    III. 40 


2. 

EXAJyiPLE    III. 


3. 


4. 


5. 


System's  response  (A)  and  the 
Three  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III. 41 


4. 

EXAMPLE  III. 


6. 


8. 


10. 


12 


System's  response  (A)  and  the 
Five  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III.  42.   EXAMPLE  III 


System's  response  (A)  and  the 
Six  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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0.        2.    _     4. 
Figure  III. 43.   EXAMPLE  III. 


6. 


8. 


10 


System's  response  (A)  and  the 
Three  Poles  and  One  Zero 
model's  response  (B)  to  a 
unit  step  input. 
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0.        2.        4. 

Figure  III. 44.   EXAMPLE  III 


6. 


8. 


10. 


System's  response  (A)  and  the  • 
Five  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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0.       1. 

Figure  III. 45 


EXAMPLE  III 


3. 


4. 


5. 


System's  response  (A)  and  the 
Three  Poles  and  Two  Zeros 
model's  response  (B)  to  a  unit 
step  input. 
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Figure  III.  46.   EXAMPLE  III. 


System's  response  (A)  and  the 
Four  Poles  and  Tv;o  Zeros 
model's  response  (B)  to  a 
unit  step  input. 
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Figure  III. 47.   EXAMPLE  III. 


System's  response  (A)  and  the 
Five  Poles  and  Two  Zeros 
model's  response  (B)  to  a 
unit  step  input. 
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Figure  III.48.   EXAMPLE  III. 


System's  response  (A)  and  the 
Six  Poles  and  Two  Zeros  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III.  49.   EXAMPLE  III. 


System's  response  (A)  and  the 
Four  Poles  and  Three  Zeros 
model's  response  (B)  to  a 
unit  step  input. 
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models  for  the  given  system.   The  system  chosen  was  one 
representing  the  control  system  of  the  pitch  rate  of  a 
supersonic  aircraft,  and  was  taken  from  Sinha  and  others 
[2] .   Sinha  selects  the  variable  parameters  in  the  system 
block  diagram  for  reasonable  pole-zero  locations,  con- 
sistent with  design  description  and  system  stability. 
With  these  parameters,  the  transfer  function  of  the  test 
system  is  given  by 

Y(s)  375000(5+0.08333) 

•=G(s)  = 


R(s)       5*^+83. 64s^+4092s^+70342s'^+85370s-^+2814271s2 

. .3310875S+281250  (III. 19) 

The  roots  of  the  characteristic  polynomial  are 
-0.092  ;   -2.024±j0.965  ;   -7 . 675± jl3 . 445  ;   -32 . 065± j 38 . 863 

The  response  of  this  system  to  a  unit  step  was 
simulated  and  computed  from  0  to  21  seconds  and  700  samples 
(at  intervals  of  0.03  seconds)  were  used  for  the  determin- 
ation of  all  possible  1   -order  models  (2<£<6)  with  "m" 
zeros  (0<m<3) ,  by  the  same  technique  and  minimizing  the 
error  criteria  function  defined  in  Chapter  II, B  as  the  in- 
tegral of  the  squares  of  the  output  errors  with  no  error 
in  steady-state  (constraint  imposed)  response  to  step  input. 

The  main  features  of  the  step  response  are  given 


below 


Time  to  reach  first  overshoot  2.9  seconds 

Maximum  overshoot  8.6% 

Steady  state  value  0  .  Ill 

Response  at  maximum  overshoot  0.12057 

Rise  time  1  second 
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Because  the  step-response  of  the  system  has  over- 
shoot a  pair  of  conjugate  poles  and  (1-2)  real  poles  were 
specified  for  the  different  models. 

The  simple  second-order  model  was  determined  as  an 
approach  for  starting  the  study.   The  state  equations  of 
the  model  are 


x-L{t)  =  X2(t) 


;   x^(0)=0 


X2(t)  =  l.-a^Xj^(t)  -  2a]^a2X2(t)  ;   X2(0)=0 


(III. 21) 


where  the  free  parameters  a^  and  a2  represent  the  damping 
ratio  and  the  natural  frequency. 

The  output  of  the  model  is 


y  (t)  =  Kxi(t) 


(III. 22) 


From  Eq.  (III. 19)  the  state  equations  of  the  system 
can  be  written 


x(t)  = 


"^1   ~^2    ^3 


-a- 


•x(t)  + 


r(t) 


(III. 23) 


^(t)  =  KCO.0833    10    .    .    03  .  x(t) 

From  the  step  response  of  second-order  linear  system  with  no 
zeros  and  taking  into  account  the  features  given  in  Eq. 
(III. 20),  good  starting  parameter  values  were  selected  as: 
a^^  =  C  =  0.7 


t^  =  21  seconds 


(III. 24) 
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A  performance  index  which  is  a  function  of  the 
deviation  between  the  output  of  both  system  and  model,  is 
defined  as  in  Chapter  II. B.   Minimization  of  this  cost 
function  with  respect  to  a^  and  a^  yields  the  "best"  second- 
order  model. 

Equations  (III. 21)  and  (III. 23)  are  integrated  with 
respect  to  time  to  calculate  the  value  of  the  error  criterion 
at  each  step  of  the  minimization  process.   The  integration 
step  size  is  chosen  as  0.03  seconds,  the  same  sample  in- 
terval of  the  system.   The  same  criterion  on  the  Bode  gain, 
steady-state  error  and  starting  parameter  boundaries  with 
flexibility  to  change  them  yields  the  results  tabulated  in 
Table  III. 16.   The  transfer  function  of  the  second-order 
model  becomes: 

0.36886 

G^(s)  = (III. 25) 

s2+2.3322s+3.3197 

and  the  pole  locations:  -1.1661  ±  jl.424. 

After  the  above  second-order  model  was  determined 
the  various  models  of  third,  fourth,  fifth  and  sixth  orders 
were  obtained.   The  errors  produced  by  the  various  models 
are  shown  in  Table  III. 20  and  are  plotted  in  Fig.  III. 50. 
For  further  com^parison  between  the  reduced  models  a  complete 
list  of  the  optimum  parameter  values  are  tabulated  in 
Tables  III.  16  to  III. 19. 

Step  responses  of  some  models  and  the  actual  system 
are  shown  in  Figs.  III. 51  to  III. 58  on  identical  time  scales. 
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2.59 

2.1 

TABLE  III. 20.   Error  criterion  (JxlO  )  for  various 

models  in  Example  IV. 

It  will  be  seen  that  most  of  the  step  responses  of 
the  determined  models  are  not  a  good  approximation  to  the 
true  response  of  the  tested  system.   Larger  overshoot  and 
smaller  settling  time  can  be  observed  and  a  singular  fact 
can  be  pointed  out  from  the  step  response  figures:  the 
decaying  part  of  the  transient  response  was  not  achieved 
by  the  determined  models  having  only  a  pair  of  complex 
conjugate  poles  and  the  others  (£-2)  poles  restricted  to 
be  real.   It  is  clear  that  the  actual  system  has  a  small 
real  pole  v-^hich  has  not  been  identified. 

Looking  at  Tables  III. 16  to  III. 19  is  noticed  that 
the  third  pole  (first  real  pole)  of  the  different  models 
is  always  greater  than  5.2,  no  optimum  value  less  than  this 
value  is  obtained.   The  selected  system  has  a  real  pole 
very  close  to  the  origin,  p^  =  0.092,  and  also  has  one  zero, 
z   =  0.0833.   It  was  thought  that  the  effect  on  the  transient 
response  of  this  zero  and  pole  would  be  minimum  due  to  the 
fact  that  they  are  close  together  and  the  zero  might  cancel 
the  residue  at  the  pole  so  that  the  contribution  to  the 
step-response  would  be  negligible.   Actually  the  pole  close 
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Figure  111,50.   Error  criterion  versus  number  of  poles 

for  Example  IV. 
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# 
p 

2 

3 

4 

5 

6 

K 

.64 

.648 

.664 

.669 

.674 

Wn 

1.822 

1.854 

1.997 

2.035 

2.068 

P3 

80.75 

25. 

24.93 

29.81 

P4 

49.65 

49.93 

44.88 

P5 

89.83 

69.86 

P6 

92.64 

104 

4.7 

4.6 

4.6 

4.9 

5.1 

TABLE  III. 16.   EXAMPLE  IV.   Optimum  models  with  no 

zeros . 


# 
p 

2 

3 

4 

5 

6 

c 

.609 

.868 

.98 

.894 

.858 

^N 

1.486 

.764 

.7 

.753 

.8 

P3 

5.2 

8.34 

6.38 

12.61 

P4 

9.72 

44.02 

22.56 

P5 

44.4 

25.89 

P6 

46.82 

zi 

5.77 

.477 

.371 

.454 

.52 

Jx 
104 

4.6 

2.7 

2.5 

3. 

2.7 

TABLE  III.  17.-  EXAMPLE  IV.   Optimum  models  with  one 

zero . 
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# 

p 

3 

4 

5 

6 

c 

.624 

.885 

.719 

.89 

Wn 

1.639 

1.195 

.654 

.759 

P3 

14.763 

.849 

3.043 

10.91 

P4 

18.43 

5.677 

11.24 

P5 

7.031 

16.18 

P6 

69.86 

^1 

9.44 

3.687 

.746 

.454 

^2 

48.75 

5.0 

.876 

23.8 

Jx 
10^ 

4.7 

3.1 

2.9 

2.48 

TABLE  III. 18. 


EXAMPLE  IV.   Optimum  models 
with  two  zeros. 


# 
p 

4 

5 

6 

c 

.894 

.895 

.98 

^N 

.755 

.731 

.694 

P3 

6.388 

1.02 

7.55 

P4 

32.9 

5.21 

7.15 

P5 

15.16 

10.19 

P6 

29.3 

^1 

.454 

.442 

.363 

^2 

.755 

.953 

7.95 

^3 

.  894 

20.1 

18.72 

Jx 
10^ 

2.7 

2.59 

2.1 

TABLE  III. 19 


EXAMPLE  IV.   Optimum  models  with 
three  zeros. 
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Figure  III. 51.   EXAMPLE  IV. 


System's  response  (A)  and  the 
Two  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input . 
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Figure  III.  52.   EXAMPLE  IV. 


System's  response  (A)  and  the 
Two  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III. 53.   EXAMPLE  IV, 


System's  response  (A)  and  the 
Three  Poles  no  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III.  54.   EXAMPLE  IV. 


System's  response  (A)  and  the 
Three  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III.  55.   EXAMPLE  IV, 


System's  response  (A)  and  the 
Four  Poles  and  no  Zero  model's 
response  (B)  to  a  unit  step 
input . 
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Figure  III.  56.   EXAMPLE  IV. 


System's  response  (A)  and  the 
Four  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III.  57. 


-  10. 

EXAMPLE  IV. 


15 


20. 


25 


System's  response  (A)  and  the 
Four  Poles  and  Two  Zeros  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III. 58.   EXAMPLE  IV 


System's  response  (A)  and  the 
Five  Poles  and  Three  Zeros 
model's  response  (B)  to  a  unit 
step  input. 
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to  the  origin  appears  to  maintain  its  predominat  effect 
mainly  in  the  decaying  part  of  the  transient  response  and 
for  that  the  determined  models  are  not  a  good  approximation. 

It  was  decided  to  impose  on  the  program  a  constraint 
on  the  possible  values  of  the  third  real  pole  in  order  to 
maintain  its  value  in  the  proximity  of  the  original  system's 
value . 

The  investigation  of  the  reduced  models  for  the  con- 
trol system  of  the  pitch  rate  of  a  supersonic  aircraft  was 
then  repeated. 

The  various  models  of  second,  third  and  fourth  orders 
were  obtained  by  the  same  technique  as  previous  runs,  using 
the  same  initial  values  for  the  complex  poles.   Besides 
constraining  the  third  pole  value  to  stay  in  the  vicinity 
of  its  original  value,  in  the  models  with  one  or  more  zeros 
a  similar  constraint  was  also  imposed  on  the  first  zero 
value . 

The  optimum  parameter  values  of  the  various  new 
models  obtained  and  the  corresponding  values  of  the  perfor- 
mance index  are  shown  in  Table  III.  21.   Step-responses  of 
both  original  and  lower  order  models  are  shown  in  Figs. 
III. 59  to  III. 65. 

It  is  worth  noticing  that  the  new  models  determined 
are  much  better  approximations  to  the  true  system  than  the 
previous  models.   The  cost  function  values  are  smaller  and 
the  third  pole  is  close  to  the  origin. 

As  a  final  checking  of  the  necessity  of  constraining 
also  the  first  zero  in  the  minimization  program  in  order  to 
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Figure  III.  59.   EXAMPLE  IV. 


System's  response  (A)  and  the 
1\^7o  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure    III.  60.       EXA14PLE    IV. 


System's  response  (A)  and  the 
Three  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III. 61.   EXAMPLE  IV, 


System's  response  (A)  and  the 
Three  Poles  and  Two  Zeros  model's 
response  (B)  to  a  unit  step  input 
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Figure  III. 62.   EXAMPLE  IV. 


System's  response  (A)  and  the 
Four  Poles  and  One  Zero  model's 
response  (B)  to  a  unit  step 
input. 
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Figure  III. 63.   EXAMPLE  IV, 


System's  response  (A)  and  the 
Four  Poles  and  Two  Zeros  model's 
response  (B)  to  a  unit  step 
input . 
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System's  response  (A)  and  the 
Four  Poles  and  Three  Zeros 
model's  response  (B)  to  a 
unit  step  input. 
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Figure  III. 65 
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System's  response  (A)  and  the 
Seven  Poles  and  One  Zero 
model's  response  (B)  to  a 
unit  step  input. 
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maintain  its  value  in  the  proximity  of  the  original  system's 
value  a  new  run  was  done.   A  new  three  poles  and  one  zero 
model  was  determined  setting  constraint  on  the  small  pole 
but  not  on  the  small  zero. 

The  optimum  parameter  values  of  the  new  model  were: 


New  Model 

Pi 

P2 

P3 

^1 

JxlO"^ 

3  Poles 
1  Zero 

1.8+J0.84 

1.8-J0.84 

.094 

.085 

.09 

which  compared  with  the  model  obtained  constraining  both 
small  pole  and  small  zero  (see  Table  III. 21)  does  not  appear 
to  be  much  different.   No  constraint  seems  to  be  necessary 
on  the  small  zero.   Only  seems  mandatory  to  impose  a  con- 
straint on  the  small  pole  upper  bound  because  the  decaying 
part  of  the  system's  transient  response. 
2 .   Remarks 

Looking  at  the  results  the  following  comments  should 
be  noted : 

a.   The  error  criterion  (J)  value  at  Table  111,20 
are  of  the  same  order  as  the  ones  in  Table  III.  5  (Example  I) 
but  the  models  are  not  a  good  approximation.   The  values  of 
(J)  at  Table  III. 21  are  much  smaller  and  the  models  are  a 
good  approximation.   It  can  be  deduced  that  the  cost  function 
(J)  is  related  mainly  to  the  steady  state  final  value  which 
in  Example  I  was  1.0  and  in  this  example  is  0.111.   Selection 
of  the  desired  model  can  be  done  taking  into  account  this 
fact. 


119 


b.  The  second-order  model  still  is  worst  and  does 
not  appear  to  be  suitable. 

c.  The  third  and  fourth  order  models  with  zeros 
achieve  a  very  acceptable  error  criterion  value. 

d.  A  model  which  gives  a  minimum  value  of  the  per- 
formance index  (J)  is  the  four  poles  one  zero  model,  al- 
though the  three  poles  one  zero  and  four  poles  two  zeros 
give  small  value  of  (J) .   Again  a  "best"  optimum  model  seems 
suitable. 

e.  The  complex  root  values  for  the  various  models 
remain  in  a  very  small  area.   The  first  real  pole  and  the 
first  real  zero  remain  in  the  proximity  of  the  original  ones 
The  system  has  one  pole  and  one  zero  very  close  to  the 
origin.   It  seems  that  in  the  cases  in  which  the  high-order 
system  has  singularities  very  close  to  the  origin  it  is 
necessary  to  keep  them  in  the  low-order  models. 

f.  Selection  of  the  desired  model  can  be  done  for 
specific  required  approximation  depending  on  the  desired 
simplicity,  looking  at  the  transient  responses  of  both 
(original  and  approximated)  and  weighting  the  cost  function 
values  (J) . 

g.  The  starting  second-order  model  assumed  gives 
good  starting  parameter  values  for  the  derivation  of  in- 
creasing order  models. 
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IV.   CONCLUSIONS 

The  investigation  presented  can  be  considered  as  another 
approach  to  find  the  best  low-order  linear  constant  system 
which  approximates  the  given  high-order  system. 

It  is  based  on  the  exhaustive  use  of  the  computer  to 
estimate  the  free  parameters  which  locate  the  roots  of  the 
model  for  which  the  integral  of  the  squares  of  the  errors 
is  minimized.   (The  error  is  defined  to  be  the  difference 
between  the  response  of  the  actual  system  and  that  of  the 
model.   The  integral  is  evaluated  between  0  and  a  selected 
■final  time.) 

The  description  of  the  actual  system  dynamics  need  not 
necessarly  be  known.   The  case  has  been  investigated  in 
which  the  input-output  data  measured  at  discrete  instants 
of  time  is  known. 

In  Chapter  III  four  examples  were  investigated  to  de- 
termine all  the  optimum  models  whose  order  varies  from  the 
second-order  with  no  finite  zeros  to  seventh-order  with 
three  real  zeros.   A  complete  set  of  graphs  showing  the 
variation  of  the  error  criteria  value  with  respect  to  the 
number  of  zeros  and  poles  of  the  model  and  all  different 
pole  and  zero  locations  on  the  s-plane  of  the  models  were 
determined. 

The  variety  of  tables  and  figures  has  been  obtained  to 
enable  the  analyst  and/or  engineer  to  make  a  rapid  and 
suitable  choice  of  the  order  of  the  model  weighting  the 


121 


cost  function  (J) .   An  analysis  has  been  presented  for 
evaluating  the  effects  of  such  attempts  in  the  various 
transient  responses.   It  is  felt  that  a  nev;  insight  has  been 
gained  in  the  cost  paid  for  the  simplicity  of  the  model  and 
in  the  accuracy  of  the  transient  response  of  the  model  re- 
lated to  the  numerical  value  of  the  error  criterion,  in 
order  to  get  an  acceptable  response. 

The  following  remarks  can  be  stated: 

1.  The  most  common  methods  of  modeling  higher-order 
systems  by  making  a  second-order  model  approximation  do  not 
appear  to  be  suitable  for  an  error  criterion  value  which 
give  acceptable  approximation  according  to  the  simplicity 
of  the  model. 

With  at  least  three  poles  and  one  zero  models  can  be 
obtained  which  give  a  very  good  approximation. 

2.  A  good  approach  for  starting  the  study  when  the 
step-response  of  the  system  has  an  overshoot,  was  the  de- 
termination of  a  pair  of  complex  roots  for  the  model  derived 
from  the  curves  of  the  step  response  of  second-order  linear 
system.   To  do  this  one  takes  into  account  the  most  common 
features  of  the  step-response  of  the  system. 

When  the  transient  response  of  the  system  shows  the 
existence  of  a  pole  close  to  the  origin,  it  appears  to  be 
mandatory  to  keep  this  singularity  also  in  the  lower  order 
model.  - 

3.  It  is  possible,  in  effect,  to  weight  the  desired 
simplicity  of  the  model  versus  selected  error  criterion 
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value.   A  "best"  optiirmm  low-order  model  which  gives  the 
minimum  of  all  cost  function  values  seems  feasible. 

4.  The  cost  function  value  drops  down  very  fast  achiev- 
ing a  very  acceptable  value  after  the  third  or  fourth  order 
models  are  obtained.   Then  as  the  order  of  the  model  is  in- 
creased the  error  criterion  value  varies  very  little  and 
remains  almost  unchanged.   So  adding  poles  to  the  model  - 
increasing  its  complexity  or  losing  its  simplicity  -  is  not 
going  to  minimize  the  cost  function  value  which  remains  in 

a  very  small  area,  i.e.,  the  magnitude  of  the  cost  is 
essentially  unchanged  by  the  addition  of  poles  and  zeros, 
and  furthermore  keeps  a  very  acceptable  value . 

Increasing  the  order  of  the  model  is  not  justified  by 
the  results  because  the  price  paid  is  high  in  comparison  with 
the  small  improvement  in  the  error  criterion  value.   Under 
such  circumstances  the  third  or  fourth  order  models  seems  to 
accomplish  the  characteristics  of  a  good  model.   The  decision 
in  the  choice  of  the  reduced  approximated  model  is  done  more 
easily  knowing  this  fact  in  the  cases  in  which  limitations 
on  the  maximum  order  of  the  model  or  sufficiency  of  the 
resultant  error  (J)  are  real  constraints. 

5.  The  computer  subroutine  optimizes  the  selected  model 
with  respect  to  a  specific  error  criterion.   The  user  has  to 
give  the  starting  parameter  values  and  it  was  seen  how 
fundamental  is  this  selection  of  values  to  achieve  the 
optimum  minimum  error  criterion.   Limitations  arise  from 
this  fact  and  from  the  convergence  properties  of  the 


123 


algorithm  which  this  subroutine  uses.  Improvement  in 
efficiency  should  be  possible  by  using  a  minimization 
program  with  known  good  convergence  properties. 

6.   In  Example  IV  was  noted  that  in  all  cases  the  small 
pole  and  small  zero  did  not  go  to  the  constraint  limit,  but 
they  found  a  value  within  the  constrained  range.   This  seems 
to  indicate  that  a  local  minimum  does  exist  but  was  missed 
in  the  unconstrained  searchs ,  probably  because  the  minimiza- 
tion program  used  too  large  an  increment. 

As  was  stated  in  point  5,  a  good  computer  program  will 
improve  largely  the  efficiency  of  the  search  of  the  model. 
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